Voice Modification for Lip Synchronization, Voice Dubbing and Karaoke
نویسندگان
چکیده
The voice modification system studied in this paper allows to ’transplant’ selected voice characteristics (pitch, loudness, timing, and/or timbre) from a given ’donor’ utterance onto another (’patient’) utterance. Several potential applications exist for such a system, depending on the voice characteristics that are transplanted. The examples studied here are lip synchronization, voice dubbing and karaoke. Using overlap-add techniques for the actual speech modification, high quality results have been obtained that convincingly illustrate the potential of voice transplantation. Unfortunately, plain voice transplantation lacks robustness as we discuss in some detail in the paper.
منابع مشابه
Effect of hydration and vocal rest on the vocal fatigue in amateur karaoke singers.
Karaoke singing is a very popular entertainment among young people in Asia. It is a leisure singing activity with the singer's voice amplified with special acoustic effects in the backdrop of music. Music video and song captions are shown on television screen to remind the singers during singing. It is not uncommon to find participants singing continuously for four to five hours each time. As m...
متن کاملVoice Morphing System for Impersonating in Karaoke Applications
In this paper we present a real-time system for morphing two voices in the context of a karaoke application. As the user sings a pre-established song, his pitch, timbre, vibrato and articulation can be modified to resemble those of a pre-recorded and pre-analyzed recording of the same melody sang by another person. The underlying analysis/synthesis technique is based on SMS, to which many chang...
متن کاملSpectral Approach to the Modeling of the Singing Voice
In this paper we present two different approaches to the modeling of the singing voice. Each of these approaches has been thought to fit in the specific requirements of two applications. These are an automatic voice impersonator for karaoke systems and a singing voice synthesizer.
متن کاملMultimodal Translation System Using Texture-Mapped Lip-Sync Images for Video Mail and Automatic Dubbing Applications
We introduce a multimodal English-to-Japanese and Japanese-to-English translation system that also translates the speaker’s speech motion by synchronizing it to the translated speech. This system also introduces both a face synthesis technique that can generate any viseme lip shape and a face tracking technique that can estimate the original position and rotation of a speaker’s face in an image...
متن کاملTitle The effect of hydration and vocal rest on vocal quality and function after Karaoke singing among people
Karaoke singing is a popular entertainment among young people It is not uncommon for Karaoke singers to experience vocal fatigue after Karaoke singing. Ten male and ten female subjects who reported experienced vocal fatigue after singing were selected to participate in a Karaoke singing task. Half of them were given hydration and vocal rest during singing and the other half of them were not giv...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2002